Dead pixel test using effective receptive field
نویسندگان
چکیده
Deep neural networks have been used in various fields, but their internal behavior is not well known. In this study, we discuss two counterintuitive behaviors of convolutional (CNNs). First, evaluated the size receptive field. Previous studies attempted to increase or control However, observed that field does describe classification accuracy. The would be inappropriate for representing superiority performance because it reflects only depth kernel and reflect other factors such as width cardinality. Second, using effective field, examined pixels contributing output. Intuitively, each pixel expected equally contribute final found there exist a partially dead state with little contribution We reveal reason lies architecture CNN solutions reduce phenomenon. Interestingly, general tasks, existence improves training CNNs. task captures small perturbation, degrade performance. Therefore, these should understood considered practical applications CNN.
منابع مشابه
Understanding the Effective Receptive Field in Deep Convolutional Neural Networks
We study characteristics of receptive fields of units in deep convolutional networks. The receptive field size is a crucial issue in many visual tasks, as the output must respond to large enough areas in the image to capture information about large objects. We introduce the notion of an effective receptive field, and show that it both has a Gaussian distribution and only occupies a fraction of ...
متن کاملTemporal receptive field estimation using wavelets.
A standard goal of many neurophysiological investigations is to obtain enough insight into a neuron's behavior that it becomes possible to predict responses to arbitrary stimuli. Techniques have been developed to solve this system identification problem, and the numerical method presented here adds to this toolbox. Stimuli and responses, beginning as functions of time, are transformed to comple...
متن کاملObject Recognition Using Multidimensional Receptive Field Histograms
This paper presents a technique to determine the identity of objects in a scene using histograms of the responses of a vector of local linear neighborhood operators (receptive elds). This technique can be used to determine the most probable objects in a scene, independent of the object's position, image-plane orientation and scale. In this paper we describe the mathematical foundations of the t...
متن کاملReceptive Field Encoding Model for Dynamic Natural Vision
Introduction: Encoding models are used to predict human brain activity in response to sensory stimuli. The purpose of these models is to explain how sensory information represent in the brain. Convolutional neural networks trained by images are capable of encoding magnetic resonance imaging data of humans viewing natural images. Considering the hemodynamic response function, these networks are ...
متن کاملCollaborative Receptive Field Learning
The challenge of object categorization in images is largely due to arbitrary translations and scales of the foreground objects. To attack this difficulty, we propose a new approach called collaborative receptive field learning to extract specific receptive fields (RF’s) or regions from multiple images, and the selected RF’s are supposed to focus on the foreground objects of a common category. T...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Pattern Recognition Letters
سال: 2023
ISSN: ['1872-7344', '0167-8655']
DOI: https://doi.org/10.1016/j.patrec.2023.02.018